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1 .  IMTRODOCTIOH 

Multiple  frequencyshlft  keying  (MPSK)  entails  choosing  one  of  N 
frequencies  as  the  carrier  or  center  frequency  for  each  transmitted 
symbol  In  a  conmunlcatlon  system*  When  frequency  hopping  Is  super¬ 
imposed  on  MFSK,  resulting  In  an  FH/MFSK  system,  the  set  of  H  possible 
frequencies  changes  with  each  hop. 

In  an  Ideal  FH/MFSK  system,  each  frequency  of  the  frequency  sets  Is 
randomly  selected  for  each  successive  hop.  This  strategy  precludes  the 
judicious  spacing  of  jamming  signals  to  exploit  the  structure  of  the 
frequency  sets  and  Increases  the  resistance  to  repeater  jaumnlng.  ^ 
Homver,  a  more  practical  Implementation,  which  requires  only  a  single 
frequency  synthesizer  instead  of  N,  selects  frequencies  having  a  fixed 
relation  to  each  other  but  a  randomly  chosen  location  within  the  total 
bandwidth.  Figures  1  and  2  depict  the  main  elements  of  receivers 
appropriate  for  these  two  strategies.  Each  receiver  Is  noncoherent  (a 
coherent  receiver  is  generally  Impractical)  and  implements  hard 
decisions.  After  the  dehopplng,  separate  code  symbol  decisions  are  made 
and  the  demodulated  symbols  are  applied  to  a  decoder,  which  produces  the 
decoded  message.  The  N  frequencies  are  separated  enough  so  that  the 
received  signal  produces  negligible  responses  in  the  Incorrect  bandpass 
filters. 


MTTBMS 


Figure  1 .  FH/MFSK  receiver  with  hard-declslon  decoding  and  multiple 
frequency-hopping  patterns. 


J.  Totrieri,  Principles  of  Military  Communication  Systems,  Artech 
Bouse,  Dedham,  MA  (1981), 
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Figure  2«  EH/MFSK  receiver  with  hard-decision  decoding  and  single 
frequency-hopping  pattern. 

Soft-decision  decoding  offers  a  significant  performance  advMtage 
for  FH/MFSK  systems  operating  in  partialrband  jamming  if  the  presence  or 
the  absence  of  jamming  in  each  channel  can  be  accurately  determined  so 
that  symbol  erasures  can  be  used.^'^  However,  an  accurate  measurement 
of  the  jamming  state  in  the  presence  of  signal  and  jamming  power  varia¬ 
tions  is  not  possible  in  most  practical  cases.  When  no  information 
about  the  jamming  is  available,  a  metric  can  probably  be  found  that 
yields  a  performance  for  a  soft-decision  system  that  is  slightly  better 
than  the  performance  of  the  corresponding  hard-decision  system. 
However,  it  is  doubtful  that  the  performance  advantage  is  sufficient  to 
justify  the  increased  Implementation  complexity  of  a  system  with  soft 
decisions,  and  if  the  metric  depends  upon  the  signal  level,  as  is  prob¬ 
able,  additional  implementation  difficulties  are  entailed.  Ihus,  we 
consider  only  hard-decision  decoding  except  for  concatenated  codes 
(sect.  4).  Appendix  A  summarizes  those  aspects  of  coding  theory  that 
are  needed  subsequently.  An  analysis  of  soft-decision  decoding  for  a 
particular  metric  is  given  in  appendix  B. 

If  the  errors  in  the  demodulated  symbols  are  assumed  to  be  independ¬ 
ent,  the  general  coding  equations  and  inequalities  of  appendix  A  can  be 
used  to  determine  the  error-rate  performance  of  an  FH/MFSK  system  with 

K,  Levitt  and  J.  K.  Omura,  Coding  Tradeoffs  for  Improved 
Performance  of  FH/MFSK  Systems  in  Partial  Band  Noise,  National 
Telecommunications  Conference,  2.  (1981),  D,9.1, 

^A.  J.  Viterbi  and  X.  N.  Jacobs,  Advances  in  Coding  and  Itodulation 
for  Noncoherent  Channels  Affected  by  Fading,  Partial  Band,  and  Multiple- 
Access  Interference,  in  A.  J.  Viterbi,  ed».  Advances  in  Communication 
Systems,  4j  Academic  Press,  Inc,,  New  York  (1975). 


hard-<leclsion  decoding.  'Rils  assunption  is  reasonable  for  fast  frequen¬ 
cy  hopping.  In  which  there  Is  a  frequency  hop  for  every  NFSK  symbol. 
For  slow  frequency  hopping.  In  vihlch  there  Is  less  than  one  hop  per  MFSK 
symbol,  the  assumption  Is  reasonable  If  symbols  are  Interleaved  over  a 
sufficient  number  of  hop  periods.  Ihe  delnterleavlng  In  the  receiver 
disperses  bursts  of  errors,  thereby  facilitating  the  removal  of  errors 
by  the  decoder. 


2.  BLOCK  CODES 

When  a  block  code  Is  used,  each  group  of  m  Information  bits  Is 
encoded  as  a  symbol,  and  then  each  group  of  w  symbols  Is  encoded  as  a 
codeword  of  c  code  symbols  that  are  transmitted.  Since  a  codeword 
represents  mw  information  bits,  there  must  be  2°”'  possible  codewords. 
In  an  FH/MFSK  system,  one  of  N  >  2°^  frequencies  Is  selected  as  the 
carrier  for  each  transmitted  symbol. 

Let  denote  the  probability  of  an  Information  bit  error  in  the 

decoded  output  and  d  denote  the  minimum  distance  between  codewords.  For 
binary  frequency-shift  keying,  let  P^  denote  the  channel  bit  error 
probability,  which  is  the  probability  of  an  error  in  a  demodulated  code 
bit.  It  is  shotm  in  appendix  A  that  for  hard-decision  decoding  of 
binary  block  codes,  Pj^^  is  approximately  given  by 
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where  [x]  denotes  the  largest  integer  less  than  or  equal  to  x.  For  the 
nonbinary  Reed-Solomon  codes,  the  approximate  expression  Is 
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where  c*2-  1/  d»*c-w+  1,  and  Pg  denotes  the  channel  symbol  error 
probability,  which  is  the  probability  of  an  error  in  a  demodulated  code 
symbol. 

Since  an  exact  derivation  of  Pg  is  difficult  when  partial-band 
jamming  causes  different  amounts  of  jamming  powers  to  enter  the  M  re¬ 
ceiver  filters,  we  use  a  union  bound  (app  A).  A  code  symbol  error 
occurs  if  the  correct  envelope  sample  does  not  exceed  the  other  N  -  1 
envelope  samples.  Since  the  probability  that  a  particular  envelope 
sample  exceeds  the  correct  one  is  a  function  of  only  two  envelope  S2un- 
ples,  it  is  the  same  as  P^,  the  channel  bit  error  probability  of  a 
frequency-hopping  system  with  binary  frequency-shift  keying.  Thus,  the 
union  bound  is 


Pg  <  (N  -  DPjj  ,  N  >  2  .  (3) 

If  N  >  2,  the  inequality  la  strict.  If  N  =  2,  we  have  Pg  =  Pj^.  When 
this  inequality  is  substituted  into  equation  (2),  we  obtain  an  upper 
bound  for  This  bound  becomes  tighter  as  (N  -  l)Pjj  decreases. 

The  total  number  of  frequency  channels  available  for  frequency 
hopping  is  denoted  by  M,  and  the  number  of  jammed  channels  is  denoted  by 
J.  By  definition,  J  <  M.  We  assume  that  the  jeunming  power  is  the  seuae 
in  all  jammed  channels  and  that  the  received  signal  power  is  independent 
of  which  channel  is  used  for  transmission  of  the  signal.  We  assume 
either  that  the  possible  frequency  channels  are  chosen  randomly  for  each 
hop  (which  is  true  by  definition  for  the  system  of  fig.  1}  or  that  the 
jammed  channels  are  randomly  chosen.  Ecpiation  (3.13)  of  Torrleri^  gives 


where 

n^  *  max(0,J  +  2  -  M)  ,  *  mln(2,J)  .  (5) 

The  Sg  depend  upon  the  form  of  the  jamming.  In  the  referenced  text,^ 
the  Sg  are  determined  for  narrowband  jamming  and  noise  jamming.  Since 
it  is  described  by  simpler  mathematics,  noise  jamming  is  considered 

^D,  J.  Torrieri,  Principles  of  Military  Communication  Systems,  Artech 
Bouse,  Dedham,  MA  (1981). 


here*  The  noise  jamming  is  modeled  as  a  Gaussian  process  with  a  flat 
paver  spectrum  over  each  j^unmed  channel*  Vte  assume,  as  does  the  refer¬ 
enced  text, ^  that  the  receiver  contains  ideal  nondistorting  bandpass 
filters  with  disjoint  passbands*  Consequently,  the  equations  derived 
for  the  Sj^  are  in  terms  of  signal,  thermal  noise,  and  jamming  powers* 
When  matched  filters  are  used,  it  is  straightforward  to  verify  (see 
Haykin**  for  a  similar  derivation)  that  the  formulas  of  the  referenced 
text^  for  noise  jamming  are  valid  if  we  replace  the  signal  power  by  the 
symbol  energy  and  replace  the  thermal  noise  and  jamming  powers  by  the 
corresponding  povrer  spectral  densities*  The  value  of  is  the  same  for 
a  bandpass-filter  receiver  and  for  a  matched-filter  receiver  if  the 
product  of  the  symbol  duration  and  the  noise  bandwidth  of  the  bandpass 
filters  is  unity*  Let  Rg  denote  the  signal  power,  the  thermal  and 
background  noise  power  in  a  channel,  and  Nj  the  jamming  power  in  a 
jaunmed  channel*  Equations  (3*30)  to  (3*32)  of  the  referenced  text^  give 


Sn  =  2  expl 


(6) 


Combining  equations  (4)  and  (6)  yields 


The  parameters  M,  N^,  J,  and  Nj  depend  upon  the  coding*  Let 
denote  the  nximber  of  channels  that  are  available  for  frequency  hopping 
if  an  uncoded  binary  modulation  is  used*  When  MFSK  and  coding  are  used 
but  the  information  rate  (or  the  message  duration)  and  the  total  hopping 
bandwidth  are  preserved,  the  number  of  available  channels  becomes  ap¬ 
proximately 

M  -  intfr  M  )  ,  (8) 

where  int(x)  is  the  largest  integer  contained  in  x  and  r^  is  the  ratio 
of  information  bits  to  transmitted  code  symbols*  For  block  codes,  r^  « 
mw/c*  The  thermal  noise  power  becomes 

^D*  J*  Torrieri,  Principles  of  Military  Communication  Systems,  Artech 
Bouse,  Dedham,  HA  (1981). 

^S.  Haykin,  Communication  Systems,  John  Wiley  s  Sons,  Inc.,  New  York 
(1978). 


(9) 
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where  Is  the  thermal  noise  power  for  uncoded  binary  modulation.  The 
number  of  jammed  channels  is  approximately 

J  =  Int(pM)  ,  (10) 

where  ji  is  the  fraction  of  the  total  hopping  band  that  contains  jeun- 
mlng.  If  the  jamming  power  is  uniformly  distributed  and  the  channels 
are  disjoint,  then 


where  denotes  the  total  jamming  power  distributed  in  the  total 

hopping  band. 

In  the  following  examples,*  we  assume  that  =  1000.  Figures  3  and 
4  depict  versus  u  for  uncoded  binary  communications  and  the  Golay 

(23,12)  code,  respectively.  The  in5>rovement  due  to  the  coding  and  the 
sharpness  of  the  pealcs  in  P^^  increases  with  the  signal->to-noise  ratio, 
and  decreases  with  the  total  jamming-to-signal  ratio, 

The  optimal  band  occupancy  for  the  jammer  increases  with  Nj|./Rg.  Fig¬ 
ures  5  to  7  depict  the  maximum  value  of  P^^^  as  a  function  of  Nj^/Rsf 
assuming  the  optimal  band  occupancy  for  the  jammer,  Rg/N^.^  =  20  dB,  and 
various  block  codes.  Thus,  these  figures  illustrate  the  worst-case 
performance  of  an  FH/MFSK  system  operating  against  partial-band  jamming 
that  can  be  optimized.  Instead  of  using  Nj^/Rg,  the  abscissas  can  be 
expressed  in  terms  of  where  is  the  energy  per  information  bit 

and  Ngj  is  the  power  spectral  density  that  corresponds  to  uniform  jam¬ 
ming  over  the  total  hopping  band.  A  straightforward  evaluation  gives 
(in  decibels) 

Ej/Ngj  (dB)  -  -Njt/Rg  (dB)  +  (dB)  +  (dB)  ,  (12) 

where  B^  is  the  frequency-channel  bandwidth  for  uncoded  binary  modu¬ 
lation  and  Tjj  is  the  information  bit  duration. 


*The  computer  programming  was  provided  by  Thomas  Wright  of  the 
Countermeasures/Counter-^ountermeasures  Center . 
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figure  3.  Information  bit  error  probability  for  no  coding,  binary  hard 
decisions,  and  partial-band  jamming. 


Figure  4.  Information  bit  error  probability  for  Golay  (23,12)  code, 
hard-decision  decoding,  and  partial-band  jamming. 
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figure  5.  Worst-case  performance  for  binary  block  {c,w)  codes  with  hard 
decisions. 


Figure  6.  Worst-case  performance  for  repetition  codes  with  hard 
decisions. 
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Figure  7.  Worst-case  performance  for  Reed-Soloraon  (c,w)  codes  with  hard 
decisions. 


The  Reed-Solomon  codes  of  figure  7  are  £uiK>ng  those  providing  the 
best  performance  against  optimal  partial-band  jamning  for  given  values 
of  N  -  c  +  1 .  The  best  codes  tend  to  have  rates  between  one-half  and 
one-third.  Since  Inequality  (3)  is  used,  the  curves  of  figure  7  are 
actually  upper  bounds  for  the  worst-case  performance.  A  conq>arison  of 
figures  5  and  7  shows  that  the  Reed-Solooon  codes  do  not  offer  a  slgnif- 
lc<uit  performance  advantange  over  the  Golay  (23.12)  code  unless  the 
required  Is  less  than  10"^  and  N  >  32.  which  requires  a  coiiq)lex 

system  lnq>lementatlon . 

Communication  systems  are  often  required  to  provide  a  bit  error 
probability  below  a  specified  value.  Hius.  a  measure  of  performance  for 
these  systems  is  the  slgnal-to-total- jamming  ratio  required  to  achieve 
the  specified  **ib-  For  exaBq;>le.  if  an  FH/MFSK  system  with  repetition 
coding  must  provide  •  10”^.  then  figure  6  Indicates  that  c  ■  7  is 
the  optimal  choice  for  minimizing  the  required  value  of  Rs/Wjt 
equivalently,  maximizing  the  value  of  that  can  be  tolerated. 


3.  CONVOLUTIONAL  CODES 


For  convolutional  codes  and  hard-decislon  viterbl  decoding,  is 
given  by  the  equations  of  appendix  A  and  equations  (7)  to  (11).  Vlterbi 
decoding  is  preferable  to  other  convolutional  decoding  procedures  when 
januning  is  capable  of  causing  relatively  high  error  rates.  If  v  bits 
are  transmitted  for  every  b  bits  shifted  into  the  encoder  register,  then 
rg  =  b/v. 

Hard-decision  decoding  of  rate  1/2  and  rate  1/3  codes  results  in  an 
error  rate  approximated  by 


7 

Pib  =  I 
i=0 


(13) 


where  the  A(d£  +  i)  are  listed  in  table  A-2  and 


(14) 


6  is  even  . 

Bbr  orthogonal  convolutional  codes  of  constraint  length  K,  r^  =  2  and 
Pj^]^  is  approximated  by  a  truncation  of  the  right-hand  side  of  inequality 
(A-27). 

figures  8  to  10  illustrate  the  worst-case  performances  of  an  FH/HFSK 
system  with  rate  1/2,  rate  1/3,  and  orthogonal  convolutional  codes, 
respectively.  It  is  assumed  that  =  1000  and  ^3/**^.^  =  20  dB.  In 
figures  8  and  9,  performance  always  Improves  with  constraint  length.  In 
contrast,  figure  10  indicates  that  orthogonal  convolutional  codes  with  K 
a  4  perform  better  than  codes  with  K  »  3  only  if  the  required  P^^j^  is 
less  than  approximately  lO”**. 


Q(fi)  =  < 


I  (f)'b('  -  ' 

i=(«+1)/2 


^^i=6/2+1  ^  u 
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Figure  10.  Worst-case  performance  for  orthogonal  convolutional  codas 
with  hard  decisions. 


4.  CONCATENATED  CODES 

A  concatenated  code  uses  multiple  levels  of  coding  to  achieve  a 
large  error-correcting  capability.  Figure  11  is  a  functional  block 
diagram  of  an  m/NFSK  system  with  concatenated  coding  that  consists  of 
two  successive  stages  of  coding.  The  inner  interleaver  and  deinter¬ 
leaver  are  unnecessary  for  fast  frequency  hopping.  For  slow  frequency 
hopping,  they  insure  the  random  distribution  of  errors  at  the  input  of 
the  inner  decoder.  The  outer  deinterleaver,  which  requires  a  corre- 


Flgure  11.  FH/NFSK  system  with  concatenated  coding:  (a)  transmitter 
and  (b)  receiver. 


spending  outer  Interleaver,  Is  usually  necessary  to  redistribute  errors 
in  the  output  of  the  inner  decoder  so  that  synbol  errors  are  distributed 
randoely  at  the  input  of  the  outer  decoder.  Fbr  the  reasons  stated  in 
section  1,  hard  decisions  are  desirable  in  the  inner  decoder  when  opti- 
■al  partial-band  jamming  is  possible. 

Analytical  expressions  can  often  be  derived  for  the  probability 
of  an  information  bit  error  at  the  output  of  the  outer  decoder.  If  the 
inner  code  is  a  binary  block  code,  the  bit  error  probability  at  the 
output  of  the  inner  decoder,  Pj^i ,  is  determined  for  hard  decisions  from 
the  right-hand  side  of  equation  (1);  that  is. 


'  i.[(a,^i)/2]' 


k  i  -C'H"  ■  ■ 

•  j  .a  .  e 


i»d^+1 


where  d.^  and  c.|  refer  to  the  inner  code.  Equations  (7)  to  (11)  give 
P^.  Ihe  ratio  of  information  bits  to  transmitted  code  symbols  is 


r  -  r  r  .  ,  (16) 

8  SO  si 

where  r^^  is  the  ratio  of  information  bits  to  outer-code  symbols  and  rg^^ 
is  the  ratio  of  outer-code  symbols  to  inner-code  symbols.  The  deinter¬ 
leaver  provides  independent  errors  at  the  input  of  the  outer  decoder. 
Thus,  if  the  outer  code  is  a  binary  block  code  and  hard  decisions  are 
made,  then  is  given  by  equation  (1)  with  Pj,^  substituted  in  place  of 
P|l^  and  d  and  c  referring  to  the  outer  code.  If  the  outer  code  is  a  rate 
1/2  or  rate  1/3  binary  convolutional  code  and  hard  decisions  are  made, 
then  Pj^jj  is  determined  from  equations  (13)  and  (14)  with  Pj,^  replacing 

As  specific  examples,  figures  12  and  13  depict  the  worst-case  per¬ 
formances  against  partial-band  janmiing  of  systems  with  repetition  codes 
as  the  inner  codes,  M^  ■>  1000,  and  ^a/^tu  *  figure  12,  the 

outer  code  is  a  (^lay  (23,12)  code;  in  figure  13,  the  outer  code  is  a 
convolutional  code  of  constraint  length  7  and  rate  1/2.  The  figures 
illustrate  that  the  degree  to  %rtiich  the  repetition  code  Improves  or 
degrades  the  performance  of  the  outer  code  alone  varies  with  the  re- 
qulimd  Pj]|,.  In  the  system  implementation,  the  outer  interleaver  and  the 
outer  deinterleaver  are  unnecessary. 


2L'5 


Mm* 


Figure  12.  Worst-case  performance  for  concatenated  codes  with  outer 
Golay  (23,12)  code,  inner  repetition  code,  and  hard  decisions. 


Figure  13.  Worst-case  performance  for  concatenated  codes  with  outer 
convolutional  code  (K  ■  7,  r  ■  1/2),  inner  repetition  code,  and  hard 
decisions. 


Consider  a  Reed-Solomon  outer  code  and  a  binary  Inner  code.  If 
there  are  m  bits  in  a  Reed-Solomon  code  symbol,  the  outer  decoder  can 
convert  a  burst  of  m  errors  at  the  inner-decoder  output  into  a  single 
syiBbol  error,  thereby  reducing  Pib  at  the  outer-decoder  output.  Ihe 
outer  deinterleaver  operates  on  symbols,  rather  than  bits,  following  a 
serial-to-parallel  conversion,  and  decorrelates  errors  in  successive 
Reed-Solomon  code  symbols. 

Por  a  block  inner  code,  an  efficient  design  sets  the  nundser  of 
Information  bits  in  the  block  codewords,  w^ ,  equal  to  an  Integer  times 
m,  and  symbol  deinterleaving  prevents  an  inner  codeword  error  from 
affecting  adjacent  symbols  in  a  Reed-Solomon  codeword.  If  w^  =  m,  the 
probability  of  a  Reed-Solomon  code  symbol  error,  Pg,  is  equal  to  the 
word  error  probability  produced  by  the  inner  decoder.  By  analogy  with 
inequality  (A-1 )  and  equation  (A-2),  we  have  the  approximation  or  equal¬ 
ity 

when  hard  decisions  are  made  by  the  inner  decoder.  Assuming  hard  deci¬ 
sions  in  the  outer  decoder,  Pib  is  determined  from  equations  (2)  and 
(17).  Figure  14  shows  examples  of  the  worst-case  performance,  assuming 
that  My  =  1000  and  Rg/N^y  =  20  dB. 

At  the  output  of  a  convolutional  inner  decoder  using  the  Viterbi 
algorithm,  the  bit  errors  tend  to  occur  over  spans  of  several  constraint 
lengths.  Consequently,  the  outer  deinterleaver  should  be  designed  to 
ensure  that  two  input  symbols  at  a  distance  less  than  the  usual  largest 
error  span  result  in  output  symbols  that  do  not  belong  to  the  same  Reed- 
Solomon  codeword.  Assuming  that  the  bit  error  rate  is  no  more  than  one- 
half  in  spans  with  errors,  then  the  bit  error  probability  at  the  inner- 
decoder  output  is  less  than  one-half  times  Pg.  thus,  for  rate  1/2  and 
rate  1/3  convolutional  inner  codes  with  hard  decisions, 

7 

>  2  y  A(d-  +  l)Q(d_  +  l)  ,  K  >  m  ,  (18) 

*  i-0  *  ' 


where  the  Inequality  is  needed  to  make  the  bound  reasonably  tight.  Hard 
decisions  in  the  outer  decoder  and  ideal  symbol  Interleaving  yield  a  Pib 
with  a  lower  bound  determined  by  equation  (2)  and  inequality  (18). 
Figure  15  depicts  examples  of  the  worst-case  lower  bounds  for  My  -  1000, 
R^/Mty  ••  20  dB,  and  an  inner  convolutional  code  with  K  >  7  and  r  >  1/2. 
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Figure  14.  Worst-case  performance  for  concatenated  codes  with  outer 
Reed-Solomon  (c,w)  code,  inner  binary  bloclc  (c^,w^)  code,  and  hard 
decisions. 


Figure  15.  Worst-case  performance  for  concatenated  codes  with  outer 
Reed-Solomon  (c,w)  code,  inner  convolutional  code  (K  <■  7,  r  >  1/2),  and 
hard  decisions. 


Soft-decision  decoding  in  the  outer  decoder  is  possible  if  the  inner 
decoder  produces  symbol  metrics.  Fbr  a  practical  example,  consider  an 
FH/NFSK  system  with  a  repetition  code  of  length  c^  as  the  inner  code. 
The  demodulator  produces  a  series  of  logical  "ones”  and  "zeros.”  The 
inner  decoder  counts  n^,  the  number  of  ones  in  each  group  of  c^  bits 
representing  an  outer-code  symbol.  The  symbol  metric  associated  with  an 
outer-code  one  is  n^ ,  whereas  c^  -  n^  is  associated  with  an  outer-code 
zero.  The  outer  decoder  forms  cumulative  metrics  that  are  the  sums  of 
symbol  metrics.  The  selection  of  the  largest  of  the  cumulative  metrics 
determines  the  decoded  output. 

System  performance  can  be  determined  by  first  evaluating  Z,  which  is 
defined  by  equation  (A-35).  If  there  are  j  errors  in  the  c^  bits 
representing  outer-code  symbol  i,  then  the  difference  between  the  symbol 
metric  corresponding  to  the  incorrect  symbol  and  the  one  corresponding 
to  the  correct  symbol  is 

m^(2,i)  -  m^(l,i)  »  2j  -  c^  .  (19) 


A  straightforward  calculation  yields 

c  \  c  -j 

j7*b^’  “  ^b^  '  exp[s(2j  -  c^)]  ,  (20) 

j-0 

where  Pj^  is  determined  from  equations  (7)  to  (11)  and  (16),  and  r^j^  = 
1/c^.  If,  for  example,  the  outer  code  is  a  rate  r  convolutional  code, 
then  can  be  determined  from  inequality  (A-19)  with  b  =  1  and  Pj^  = 
^ib-  Since  the  Chernoff- Jacobs  bound  of  appendix  C  applies, 
0-1/2  and  P^^  is  approximated  by 

7 

1 

^ib  -  2  2^''(‘*f 

i-0 

where  the  A(d£  +  1)  are  listed  in  table  A-2.  Equation  (16)  implies  that 
rg  -  r/c,. 

As  a  specific  example,  figure  16  illustrates  the  worst-case  perform¬ 
ances  against  partial-band  jamming  of  FH/MFSK  systems  having  outer 
convolutional  codes  with  K  ■  7  and  r  »  1/2,  inner  repetition  codes  with 
c.|  -  2,  3,  4,  or  5,  1000,  and  Rg/H^^  -  20  dB.  For  a  required  Pj^jj  « 

10~^,  the  optimal  choice  for  c^  is  3.  Comparing  figures  13  and  16 
indicates  that  for  c^  -  3,  a  soft-limiting  outer  decoder  requires  a 
signal  power  of  approximately  1.5  dB  less  than  a  hard-limiting  one  does 
to  provide  Plb  -  10-5. 
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Figure  16.  Worst-case  performance  for  concatenated  codes  with  outer 
convolutional  code  (K  =  7,  r  =  1/2),  inner  repetition  code,  hard  inner 
decisions,  and  soft  outer  decisions. 


5.  LIMITER-DISCRIMINATOR  DEMODULATION 

Frequency-hopping  systems  with  continuous -phase  frequency-shift 
keying  (CPESK)  offer  reduced  spectral  splatter  and  a  potentially  im¬ 
proved  performance.^  After  each  frequency  hop,  a  binary  CPFSK  system 
shifts  between  two  frequencies  separated  by  h/Tjj,  where  h  is  the  devia¬ 
tion  ratio  and  T^  is  the  channel  bit  duration.  Demodulation  is  done  by 
a  limiter-discriminator'*  in  general,  but  differential  demodulation  is 
also  possible.  Thus,  the  FU/MFSK  receiver  differs  from  the  receiver  of 
figure  1  or  figure  2  in  that  the  envelope  detector  is  replaced  by  a 
limiter-discriminator  or  differential  detector. 


^D.  J.  Torrieri,  Principles  of  Military  Communication  Systems,  Artech 
House,  Dedham,  MA  (1981), 

‘*S.  Haykin,  Communication  Systems,  John  Wiley  s  Sons,  Inc,,  New  York 
(1978), 
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The  theory  of  limiter-diecriminator  demodulation^  provides  compli¬ 
cated  expressions  for  P(E),  the  bit  error  probability  in  the  absence  of 
frequency  hopping.  However,  the  theoretical  P(E)  can  often  be  ade¬ 
quately  approximated  by  a  simple  equation  such  as 


P{E)  ,  (22) 

where  erfc(  )  denotes  the  complementary  error  function,  Ej^/Nq  is  the 
energy-to-noise -density  ratio,  and  C  is  a  parameter  that  depends  upon  h 
and  the  product  of  Tw  and  the  noise  bandwidth,  B.  The  best  performance 
in  white  Gaussian  noise  results  when  h  =  0.7  and  BTj^  =1.  The  corre¬ 
sponding  value  of  obtained  by  fitting  equation  (22)  to  the  theoret¬ 

ical  curve,  is  approximately  0.75.  In  contrast,  equation  (22)  with 
5  »  0.78  gives  P(E)  for  a  coherent  FSK  system  with  a  minimum  correla¬ 
tion  coefficient.*^ 


Although  the  frequency  of  a  CPESK  signal  varies,  its  compact  spec¬ 
trum  allows  it  to  be  considered  a  single-channel  modulation  for  which 
there  is  only  a  single  carrier  frequency  between  hops.  It  follows  from 
equation  (22)  with  BT^,  =  1  that  the  channel  bit  error  probability  for  a 
frequency-hopping  system  with  binary  CPBSK  is 


*’b  **  S 


Nt  +  N 


Applications  of  equation  (23)  with  5  =  0.75  (instead  of  eq  (7)) 

yield  worst-case  performances  for  frequency-hopping  systems  with 
limiter-discriminator  demodulation  that  are  typically  on  the  order  of  4 
dB  better  than  the  performances  of  analogous  systems  with  envelope- 
detector  demodulation.  Figure  17  illustrates  the  potential  performances 
against  optimal  partial-band  jamming  when  the  concatenated  codes  of 
figure  16  are  used  with  CPF5K  and  limiter-discriminator  demodulation. 
The  improvement  increases  with  the  number  of  inner-code  repetitions. 

The  potental  performance  of  an  Fh/CPFSK  system  is  significantly 
degraded  in  practice  by  the  effects  of  frequency-hopping  transitions, 
which  were  ignored  in  deriving  equation  (23).  The  degradation  becomes 
more  prounounced  as  the  hopping  period  decreases.  Nevertheless,  CP  FSK 
appears  to  be  the  most  attractive  choice  for  the  data  modulation  of  most 
frequency-hopping  systems. 


‘*S.  Haykin,  Coaminlcatlon  Systems,  John  ffiley  s  Sons,  Inc.,  New  York 
(1978). 

F.  Pawula,  On  the  Theory  of  Error  Rates  for  Narrow-Band  Digital 
FM,  IEEE  Trans.  Communications,  29  f November  1981),  1634. 
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Figure  17^  Worst-case  performance  for  limiter-discriminator  demodu¬ 
lation  and  concatenated  codes  with  outer  convolutional  code  (K  =  7,  r  = 
1/2) f  inner  repetition  code,  hard  inner  decisions,  and  soft  outer  deci¬ 
sions. 
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In  this  appendix,  the  basic  facts  of  coding  theory^”^  are  summa¬ 
rized  and  used  to  derive  equations  for  the  error  probabilities  of  en¬ 
coded  systems. 


A-1 .  BLOCK  CODES 

In  digital  communication  systems  using  block  codes,  information  is 
transmitted  as  blocks  of  symbols  called  codewords.  Each  symbol  is 
selected  from  an  alphabet  of  possible  symbols.  In  binary  communi¬ 
cations,  the  two  possible  symbols  are  the  logical  "one"  and  the  logical 
"zero."  If  each  of  the  codewords  can  be  expressed  as  linear  algebraic 
sums  of  linearly  independent  code  vectors  (sequences  having  the  same 
length  as  the  codewords),  the  code  is  called  a  linear  block  code.  Fbr 
binary  data,  the  code  bits  generated  by  a  linear  block  code  are  modulo- 
two  sums  of  the  information  bits.  A  systematic  block  code  is  a  code  in 
which  the  information  symbols  appear  unchanged  in  the  codeword,  which 
also  has  additional  parity  symbols.  The  code  rate  is  defined  as  the 
ratio  of  information  symbols  to  the  total  number  of  symbols  in  a  code¬ 
word. 


The  Hamming  distance  between  two  sequences  with  an  equal  number  of 
symbols  is  defined  as  the  number  of  positions  in  which  the  symbol  of  one 
sequence  differs  from  the  corresponding  symbol  of  the  other  sequence. 
The  minimum  Hamming  distance  between  any  two  possible  codewords  is 
called  the  minimum  distance  of  the  code. 

After  the  waveform  representing  a  codeword  is  received  and  demodu¬ 
lated,  the  decoder  uses  the  demodulator  output  to  determine  the  informa¬ 
tion  symbols  corresponding  to  the  codeword.  If  the  demodulator  produces 
a  sequence  of  discrete  symbols  and  the  decoding  is  based  on  these  sym¬ 
bols,  the  process  is  called  hard  limiting  or  a  hard  decision.  Con¬ 
versely,  if  the  decoding  is  based  on  analog  or  multilevel  quantized 
samples  of  the  waveform,  the  process  is  called  soft  limiting  or  a  soft 
decision.  The  advantage  of  soft-decision  decoding  is  that  reliability 
or  qioality  indicators  are  used  in  making  the  decisions. 

When  hard  decisions  are  made,  a  maximum-likelihood  decoder  assumes 
that  the  correct  codeword  is  the  one  that  differs  in  the  least  number  of 
positions  from  the  demodulator  output  sequence.  Correct  decoding  occurs 
if  the  number  of  incorrect  symbols  in  the  demodulator  output  is  less 

^A.  J.  Viterbi  and  J.  K.  Omura,  Principles  of  Digital  Communication 
and  Coding,  McGraw-Hill  Book  Co,,  New  York  (1979). 

^G,  C,  Clark  and  J,  B,  Cain,  Error-Correction  Coding  for  Digital 
Communications,  Plenum  Press,  New  York  (1981). 

^N.  W.  Peterson  and  E.  J.  Weldon,  Error-Correcting  Codes,  2nd  ed.. 
The  MIT  Press,  Cambridge,  MA  (1972). 
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than  half  the  Minimum  distance,  d,  between  codewords.  Por  some  codes, 
it  is  possible  to  decode  correctly  in  some  cases  where  the  number  of 
errors  exceeds  d/2  because  of  the  sparseness  of  the  codewords  in  the 
vector  space.  By  ignoring  this  possibility,  we  can  bound  the  probabil¬ 
ity  of  error  in  a  decoded  word,  which  is  denoted  by  P^.  In  a  (c,w) 
block  code,  c  code  symbols  represent  w  information  symbols.  We  assume 
the  statistical  independence  of  errors  in  demodulated  code  symbols, 
which  can  often  be  ensured,  if  necessary,  by  appropriate  symbol  inter¬ 
leaving.  Since  there  are  (. )  distinct  ways  in  which  i  errors  may  occur 
among  c  symbols, 

c 

i=t(d+1)/2] 

where  lx]  denotes  the  largest  integer  less  than  or  equal  to  x,  and  Pg  is 
the  channel  symbol  error  probability,  which  is  the  probability  of  error 
in  a  demodulated  code  symbol.  The  tightness  of  this  bound  depends  upon 
the  decoding  algorithm.  If  the  algorithm  makes  no  attempt  to  correct 
[(d  +  l)/2]  or  more  errors,  then  P^  is  equal  to  the  bound. 

A  perfect  code  is  a  block  code  such  that  every  c-symbol  sequence 
is  at  a  distance  of  at  most  e  from  some  c-symbol  codeword,  and  the  sets 
of  all  sequences  at  distance  e  from  each  codeword  are  disjoint.  There¬ 
fore,  perfect  codes  correct  exactly  e  =  (d  -  1)/2  errors,  where  d  is 
odd,  and  fail  to  correct  more  than  e  errors.  Assuming  the  independence 
of  symbol  errors,  we  can  replace  inequality  (A-1 )  with 

c 

'w  ■  21 

i=(d+1)/2 

The  only  known  perfect  binary  codes  are  the  Hamming  codes,  repeti¬ 
tion  codes  of  odd  length,  and  the  Golay  (23,12)  code.  In  a  Hamming 
(c,w)  code,  the  numbers  of  code  bits  and  information  bits  are  related  by 
c  =  -  1.  Since  d  =  3  for  Hamming  codes,  they  are  capable  of  cor¬ 

recting  all  single  errors  and  detecting  two  or  fewer  errors.  Equation 
(A-2)  applies  with  Pg  =  Pj^,  where  Pj^  is  the  channel  bit  error  probabil¬ 
ity,  which  is  the  probability  of  error  in  a  demodulated  code  bit. 

Repetition  codes  have  one  information  bit  represented  by  c  code 
bits.  For  hard-decision  decoding,  c  is  odd  and  the  decoder  decides  the 
logical  state  of  the  information  bit  according  to  the  states  of  the 
majority  of  the  demodulated  bits.  'Rius,  the  decoder  can  correct  all 
combinations  of  (c  -  1)/2  or  fewer  errors,  but  no  patterns  of  more 
errors.  In  this  case,  P^  is  the  probability  of  error  in  a  decoded 
information  bit,  which  is  denoted  by  Pib*  Since  d  s  c,  equation  {A-2) 
becomes 
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^’ib  ■ 


£ 


_  •  <^-3) 

i=(c+1 )/2 

The  Golay  (23,12)  code  has  d  =  7  and,  thus,  can  correct  three  bit 

**'*'?”•  (24,12)  code  is  formed  by  adding  an  overall 

parity  bit  to  the  perfect  Golay  (23,12)  code,  thereby  increasing  the 
minimum  distance  to  d  =  8.  As  a  result,  three  or  fewer  errors  can 
always  be  corrected  and  one-sixth  of  the  code  vectors  with  four  errors 
can  be  corrected.  Five  or  more  errors  are  never  corrected.  Thus, 
assuming  the  independence  of  bit  errors,  the  word  error  probability  for 
the  extended  Golay  code  is 
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i=5 

The  extended  Golay  (24,12)  code  is  usually  preferable  to  the  Golay 
(23,12)  code,  which  usually  gives  a  slightly  better  performance  in  the 
presence  of  white  Gaussian  noise,  because  it  allows  a  less  complex 
decoding  implementation  and  it  has  a  code  rate  of  exactly  one-half, 
which  simplifies  the  system  timing.  The  design  of  an  extended  Golay 
decoder  may  be  simplified  if  no  attempt  is  made  to  correct  four 
errors.  In  this  case,  equation  (A-4)  must  be  replaced  by  inequality 
(A-1)  with  c  =  24,  d  =  8,  and  Pg  =  Pj^. 

TTie  most  important  nonbinary  block  codes  are  probably  the  Reed- 
Solomon  codes, 2' 3  which  provide  the  largest  possible  minimum  code  dis¬ 
tance  of  any  linear  code  with  specified  values  of  c  and  w.  A  Reed- 
Solomon  code  has  an  alphabet  of  2™  symbols  and  c  =  2"*  -  1  symbols  per 
codeword,  where  m  is  the  number  of  bits  per  symbol.  If  the  codeword 
represents  w  information  symbols,  the  minimum  distance  isd=c-w+ 
1.  Since  the  Reed-Solomon  codes  are  not  perfect  codes,  inequality  (A-1) 
applies  to  hard-decision  decoding. 

To  compare  codes  with  different  numbers  of  information  symbols 
represented  by  the  codewords,  we  need  the  probability  of  an  information 
symbol  error,  at  the  output  of  the  decoder.  Since  not  every  word 

error  results  in  a  symbol  error,  Pj^  <  P^.  Since  for  every  linear 
block  code  there  exists  a  systematic  linear  block  code  that  is  equiva- 
lent  in  performance,^'^  practical  block  codes  are  usually  systematic 

^A.  J.  Viterbi  and  J.  K.  Omara,  Principles  of  Digital  Communication 
and  Coding,  McGraw-Hill  Book  Co,,  New  York  (1979). 

^G.  C.  Clark  and  J,  B.  Cain,  Error-Correction  Coding  for  Digital 
Communications,  Plenum  Press,  New  York  (1991), 

M.  Peterson  and  E.  J,  Weldon,  Error-Correcting  Codes,  2nd  ed.. 
The  MIT  Press,  Cambridge,  MA  (1972). 
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and,  thus,  systematic  codes  are  assumed  in  the  subsequent  analysis. 
Given  that  a  word  error  occurred,  the  probability  of  an  information 
symbol  error  for  a  systematic  code  is  the  same  as  the  probability  of 
error  in  any  symbol  of  the  codeword.  Hie  latter  probability  is  at  least 
d/c  because  an  incorrectly  chosen  codeword  is  at  least  a  distance  d  from 
the  correct  codeword,  assuming  that  the  decoder  attempts  to  decode  all 
possible  received  sequences.  Thus, 


-  is 


<  P 


w 


(A-5) 


Since  an  incorrectly  chosen  codeword  is  often  exactly  a  distance  d  from 
the  correct  codeword,  the  lower  bound  is  usually  tight  unless  P^  is 
large . 


Consider  practical  codes  for  which  P^  is  given  approximately  or 
exactly  by  equation  (A-2).  Let  A(i)  denote  the  event  that  i  symbol 
errors  occur  in  a  demodulated  word  of  c  code  symbols  at  the  decoder 
input.  Then  P^g  is  equal  to  the  summation  over  i  of  the  product  of  the 
probability  of  A(i)  and  the  probability  of  an  error  in  a  decoded  infor¬ 
mation  symbol  given  A(i).  Fbr  [(d  +  l)/2]  <  i  <  d,  the  latter  proba¬ 
bility  is  approximated  by  d/c;  for  d  <  i  <"0,  it  is  approximated  by 
i/c,  the  probability  of  an  error  in  a  demodulated  code  symbol  at  the 
decoder  input  given  A(i).  Therefore,  for  hard-decision  decoding. 


is 


I  ^  (i)'i(’  - 


i=t(d+1)/2l 


(A-6) 


c 


isd+1 


The  right-hand  side  of  this  equation  is  always  within  the  bounds  of 
inequality  (A-5)  and  gives  P^^g  =  1  when  Pg  =  1,  as  desired. 


For  binary  communications,  *’is  equal  to  the  probability  of  an 
information  bit  error,  P^jj* 


P 


ib 


d 

E 


[(d+1)/2] 


(A-7) 


i-d+1 
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For  repetition  codes,  equation  (A-7)  reduces  to  equation  (A-3),  as 
desired.  Equation  (A-7)  and  the  bounds  of  inequality  (A-5)  are  compared 
in  figure  A-1  for  the  Golay  (23,12)  code. 


g  1i-« 

I 


Figure  A-1.  Information  bit  error  probability  as  function  of  channel 
bit  error  probability  for  Golay  (23,12)  code. 

In  nonbinary  communications,  an  information  symbol  represents  m 
information  bits.  We  assume  that  an  incorrectly  decoded  information 
symbol  is  equally  likely  to  be  any  of  the  remaining  symbols  in  the 
alphabet.  Among  2™  equally  likely  symbols,  a  given  bit  is  a  one  in  2™”^ 
cases  and  a  zero  in  2"*'^  cases.  Ilius,  when  there  are  2"*  -  1  equally 
likely  Incorrect  symbols. 


2”  -  1 


(A-8) 


For  Reed-Solomon  codes,  equations  (A-6)  and  (A-8)  and  c  ■  2®  -  1  imply 
that 
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P 

s  •' 

(A-9) 

*  i; 

i-d+1  J 

for  hard-decision  decoding. 

The  Hamming  weight  of  a  codeword  is  defined  as  the  number  of 
nonzero  symbols  in  a  codeword.  Fbr  binary  codes,  the  Hamming  weight  is 
the  number  of  ones  in  a  codeword.  The  set  of  Hamming  distances  from  a 
given  binary  codeword  to  the  other  valid  codewords  is  the  same  for  all 
codewords . ^ ^  Since  the  set  of  distances  from  the  all-zero  codeword  is 
the  same  as  the  set  of  weights  of  the  nonzero  codewords,  the  set  of 
weights  is  equivalent  to  the  set  of  distances.  Analytical  expressions 
for  the  weight  distribution  are  kno«m  for  the  Hamming  and  Reed-Solomon 
codes. The  weight  distributions  of  other  codes  can  be  determined  by 
examining  all  2^  valid  codewords  if  w,  the  number  of  information  bits, 
is  not  too  large.  The  weight  distribution  of  the  Golay  codes  is  listed 
in  table  A-1 . 


TABLE  A-1 .  WEIGHT  DISTRIBUTION  OP  GOLAY  CODES 


Weight 

Number  of 

codewords 

(23,12)  code 

(24,12)  code 

0 

1 

1 

7 

253 

0 

8 

506 

759 

11 

1288 

0 

12 

1288 

2576 

15 

506 

0 

16 

253 

759 

23 

1 

0 

24 

0 

1 

4096 

4096 

^A.  J.  viterbi  and  J.  K,  Omira,  Principles  of  Digital  Communication 
and  Coding,  McGraw-Hill  Book  Co.,  Mew  York  (1979). 

^G.  C.  Clark  and  J.  B.  Cain,  Error-Correction  Coding  for  Digital 
Communications/  Plenum  Press,  Mew  York  (1981). 

%.  tf.  Peterson  and  E.  J.  Weldon,  Error-Correcting  Codes,  2nd  ed.. 
The  MIT  Press,  Cambridge,  MA  (1972). 
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A  sof t>decislon  decoder  makes  decisions  by  selecting  the  largest 
of  the  cumulative  metrics,  which  are  measures  of  the  likelihoods  of 
codewords.  An  upper  bound  for  P^  follows  from  fundamental  considera¬ 
tions.  Because  of  the  countable  subadditivity  of  probability  measures, 
the  probability  of  a  finite  or  countable  union  of  events  A^,  n  =  1,  2, 
.  .  .,  satisfies 


KuaJ  <I  K»„) 


(A-10) 


In  communication  theory,  a  bound  obtained  from  this  inequality  is  called 
a  union  bound.  Let  N(S)  denote  the  number  of  codewords  having 

weight  6.  Let  Q(6)  denote  the  probability  that  the  cumulative  metric 
for  an  incorrect  codeword  at  distance  5  from  the  correct  codeword  ex¬ 
ceeds  the  cumulative  metric  for  the  correct  codeword.  Hie  union  bound 
and  the  relation  between  weights  and  distances  imply  that 


<  I  N(6)Q{6) 


(A-11) 


where  the  summation  is  over  all  values  of  6  for  which  there  are  valid 
codewords.  Metrics  are  defined  so  that  Q(S^)  <  -  ^2* 

in  terms  of  the  minimum  distance,  d,  we  have  the  much  weaker  bound 


<  (v  -  1)Q(d) 


(A-12) 


where  v  is  the  number  of  valid  codewords.  Hiis  bound  is  useful  when  the 
only  known  parameter  of  a  code  is  the  minimum  distance  between  code¬ 
words.  The  bound  is  tight  if  the  distances  from  a  given  codeword  are 
all  close  to  d. 

Ftor  a  repetition  code,  P^^^j  *  Q(c),  where  c  may  be  even  or  odd  for 
soft-decision  decoding,  in  other  cases,  approximate  expressions  for  P^^^ 
and  P^g  can  be  obtained  by  combining  inequality  (A-11)  or  (A-12)  with 
the  lower  bound  of  inequality  (A-3)  and  equation  (A-8).  For  example, 
using  table  A-1 ,  we  obtain 

Pj^jj  [759Q(8)  +  2576Q(12)  +  759Q(16)  +  Q(24)]  (A-13) 

for  the  extended  Go lay  (24,12)  code. 
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A>2.  CONVOLUTIONAL  CODES 

A  convolutional  encoder  converts  an  input  of  b  information  symbols 
into  an  output  of  v  code  symbols  that  are  a  function  of  both  the  current 
input  and  preceding  information  symbols.  A  convolutional  encoder  can  be 
implemented  with  a  shift  register  and  linear  logic.  The  outputs  of 
selected  register  stages  are  added  modulo-two  to  form  the  code 
symbols.  After  b  symbols  are  shifted  into  the  register  and  b  symbols 
are  shifted  out,  a  commutating  switch  reads  out  v  code  symbols  in  se¬ 
quence.  The  code  rate,  which  is  the  ratio  of  input  symbols  to  output 
symbols,  is  r  =  b/v.  The  constraint  length,  K,  is  defined  as  the  total 
number  of  shift  register  stages  in  the  encoder. 

We  assume  that  a  viterbi  decoder  is  used  to  generate  the  infor¬ 
mation  bits  in  the  receiver.  Let  a(5,i)  denote  the  number  of  paths 
diverging  at  a  node  from  the  correct  path,  having  Hamming  distance  6  and 
i  information  symbol  errors  over  the  unmerged  segment.  Let  d£  denote 
the  minimum  free  distance,  which  is  the  minimum  distance  of  any  unmerged 
segment  from  the  correct  path.  Let  Q(6)  denote  the  probability  of  an 
^rror  in  comparing  the  correct  path  segment  with  a  path  segment  that 
differs  in  6  symbols.  Ftom  the  union  bound,  it  can  be  shown  that  the 
probability  of  an  information  symbol  error  after  Viterbi  decoding  is 
bounded  by^ ' 2 


I  I  .  (A-14) 

°  i=1  6=d^ 

Fbr  binary  codes,  Pj^^  is  equal  to  the  probability  of  an  information  bit 
error, 

Among  the  convolutional  codes  of  a  given  code  rate  and  constraint 
length,  the  one  with  the  best  distance  properties  can  sometimes  be 
determined  by  a  complete  computer  search.  After  elimination  of  the 
catastrophic  codes,  for  which  a  finite  number  of  demodulated  bit  errors 
can  cause  an  infinite  number  of  decoded  information  bit  errors,  the 
codes  with  the  largest  value  of  d^  are  selected.  Then  the  values  of  the 
total  information  weights. 


A(6)  »  I  ia(6,i)  ,  6  >  , 

1-1 


{A-15) 


^A.  J.  Viterbi  and  J.  K,  Omira,  Principles  of  Digital  Communication 
and  Coding,  McGraw-Hill  Book  Co.,  Hew  York  (1979). 

2g.  C.  Clark  and  J.  B.  Cain,  Error-Correction  Coding  for  Digital 
Coamjnications,  Plenum  Press,  Hew  York  (1981). 
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are  examined  for  each  of  the  selected  codes.  All  codes  that  do  not  have 
the  minimum  value  of  ACd^)  are  eliminated.  If  more  than  one  code  re¬ 
mains,  codes  are  eliminated  on  the  basis  of  the  minimal  values  of  A(d^ 
1),  A(d^  *2),  .  .  .,  until  one  code  remains.  For  binary  codes  of  rate 
1/2  and  rate  1/3  and  constraint  lengths  up  to  9  and  8,  respectively,  the 
optimal  codes  have  been  determined.**  For  these  codes,  table  A- 2  lists 
the  corresponding  values  of  d^  and  A(df  -fi),  1=0,  1,  ...,  7.  In 
terms  of  A(d^  +1),  equation  (A-14)  becomes 

m 

I  A[d^  +  i)Q{d^  +  i)  .  (A-16) 

i»0 


TAILI  A>2.  PMUMETBt  VALUES  fOR  BEST  CONVOLUTIONAL  COOES 


Oote 

K  r 

»(o*) 

»(0f  ♦  1) 

A(d,  ♦  J) 

Mo*  ♦  3) 

A(d,  ♦  4) 

A(d,  +  5) 

A{d,  ♦  6) 

A[d,  ♦  7) 

3 

va 

s 

1 

4 

13 

32 

80 

192 

448 

1024 

4 

VJ 

6 

3 

7 

18 

49 

130 

333 

836 

2069 

S 

va 

7 

4 

13 

30 

72 

225 

500 

n324 

3680 

6 

i/a 

e 

3 

36 

33 

62 

332 

701 

2^342 

5503  • 

7 

va 

10 

36 

0 

311 

0 

1404 

0 

11»633 

0 

6 

va 

10 

3 

33 

60 

148 

340 

1008 

2*642 

6748 

9 

1/a 

ia 

33 

0 

381 

0 

2179 

0 

15*035 

0 

3 

1/3 

8 

3 

0 

15 

0 

58 

0 

201 

0 

4 

1/3 

10 

6 

0 

6 

0 

58 

0 

118 

0 

3 

1/3 

13 

13 

0 

13 

0 

56 

0 

320 

0 

6 

1/3 

13 

1 

8 

36 

20 

19 

62 

86 

204 

7 

1/3 

14 

1 

0 

30 

0 

53 

0 

184 

0 

8 

1/3 

16 

1 

0 

24 

0 

113 

0 

287 

0 

If  a  binary  code  is  used  and  the  Viterbi  decoder  makes  a  hard 
decision  on  each  demodulator  output  bit,  an  exact  expression  for  Q(6) 
can  be  written.  When  the  correct  path  is  compared  with  an  incorrect 
one,  correct  decoding  results  if  the  number  of  incorrect  bits  in  the 
demodulator  output  is  less  than  half  the  number  of  bits  in  which  the  two 
paths  differ.  If  the  number  of  incorrect  bits  is  exactly  half  the 
number  of  differing  bits,  then  either  of  the  two  paths  is  chosen  with 
equal  probability.  Assuming  the  independence  of  bit  errors,  it  follows 
that 

'  6  is  odd  , 

i-(6+1)/2 

(A-17) 

t  (iVb0-^)®''-T(6/2)[^bt’-^b)]'''  ' 

1 -6/2+1 

6  is  even  , 

'*J.  P.  Odemfalder ,  Optimal  Decoding  of  Convolutional  Codes,  Doctoral 
Dissertation,  University  of  California  at  Los  Angeles  (1970), 
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where  P],  Is  the  probability  of  error  in  choosing  between  the  correct  bit 
and  an  incorrect  one. 

It  is  shown  below  that  when  soft  decisions  are  made,  Q(6)  can 
often  be  bounded  by  a  function  of  the  form 

Q(fi)  <  oZ®  ,  ( 


tdiere  a  and  Z  are  independent  of  j.  Inequalities  (A-16)  and  ' 
imply  that 

d  +i 

i=0 


In  principle,  A(6)  can  be  determined  from  the  augmented  gener¬ 
ating  function,  T(D,I),  trhlch  depends  upon  the  structure  of  the  convolu¬ 
tional  code, ^'2  expansion  of  the  augmented  generating  function  has 
the  form 


T(D,1)  [  I  a(«,i)DV  . 

i-1  6=d^ 


The  derivative  at  I  >  1  is 


3T(D,I) 


ai 


1=1 


I  I  ia(6,i)D* 


i-1  6=^3, 


=  I  A(d.  +  i)D 


dj+1 


i=0 


(A-20) 


(A-21) 


Thus,  the  bound  for  P^^,  given  by  inequality  (A-16),  is  determined  by 
substituting  Q(6)  in  place  of  in  this  expansion  and  multiplying  the 
result  by  1/b.  Fbr  soft-decision  decoding,  equation  (A-21)  and  inequal¬ 
ity  (A-19)  imply  that 


J.  Vitexbi  and  J.  K,  Oraura,  Principles  of  Digital  Conminication 
and  Coding,  McGrav-Hill  Book  Co.,  New  York  (1979). 

^G.  C,  Clark  and  J.  B.  Cain,  Error-Correction  Coding  for  Digital 
Coaaunications,  Plenum  Press,  New  York  (1981). 
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g  3T(D,1) 

is  -  b  31  1*1, D-2 


(A-22) 


Closed-form  expressions  for  T(D,I)  are  known  for  the  orthogonal 
and  the  dual-k  convolutional  codes.  Ihe  encoder  for  an  orthogonal 
convolutional  code  of  constraint  length  K  generates  one  of  2^  orthogonal 
binary  sequences  of  length  v  *  2*^  for  each  input  bit.  Hius,  the  rate  of 
the  code  is  2”*^.  The  augmented  generating  function  can  be  shoum  to  be^ 


ID^v/2fi  - 


1  -  +  l[l  -  D 


(v/2)(K-1 ) 


]} 


.Kv/2,,  _  v/2>.2 


T(D,I) 

Differentiation  yields 

aT(D,I) I  _ 

'  (1  -  2d''/2  ^^Xv/2^2  • 

Since  b  »  1  and  Pjj^g  »  P^^^,  equation  (A-24)  and  inequality  (A-22)  give 

-  Z^/2i2 


(A-23) 


fl  - 


(A-24) 


,  v  =  2 


(A-25) 


for  soft-decision  decoding. 

To  determine  P^j^  for  hard-decision  decoding,  we  must  first  expand 
equation  (A-24)  in  powers  of  D  because  equation  (A-17)  does  not  have  the 
form  of  inequality  (A-18).  We  use  the  identity 

[l  -  (X  +  y)]”^  -  I  n(x  +  y)"~’  *  I  "  I  ("  7  ^)x^y"”^“’  (A-26) 

n*1  na1  i*0 

and  substitute  Q(5)  in  place  of  D^.  The  result  is 

■■ib  <  j  ”  °l  (”  I  -  1  -  1  *  Ki  .  K>] 

n*1  1»0 

(A-27) 

-  2Q[2’'"\n  -  i  +  Ki  +  K)]  +  Q[2’^"’(n  -  i  +  1  +  Ki  +  K)]}  , 

where  Q[  ]  is  given  by  equation  {A-17). 


*A.  J.  viterbi  and  J.  K,  Omra,  Principles  of  Digital  Coamuinication 
and  Coding,  McGraw-Hill  Book  Co.,  Hew  York  (1979). 
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A  dual-k  code  Is  a  nonbinary  convolutional  code.  ‘Hie  encoder 
shifts  one  k-blt  information  symbol  at  a  time  into  a  shift  register  of 
2)c  binary  stages  (two  symbol  stages).  For  each  information  symbol,  a 
rate  1/v  encoder  generates  v  code  symbols.  Each  code  symbol  is  one  of 
2^  possible  symbols  and  may  be  transmitted  as  one  of  2  modulated  sig¬ 
nals. 


Among  the  dual-k  codes,  the  codes  with  the  best  distance  proper¬ 
ties  can  be  shown  to  have 5 


T(D,I) 


-  i)d^I 

1  -  i[vd’'''  ♦  (2"  -  1  -  vjD”) 


which  implies  that 


3T(D,1)  I  _ [2*^  -  i}d^^ _ 

1^=’  ■  [1  -  vD^-’  -  (2^^  -  1  - 


(A-28) 


(A-29) 


Analogously  to  equation  (A-8),  the  probability  of  an  information  bit 
error  is  related  to  the  probability  of  an  information  symbol  error  by 


P 


ib 


(A-30) 


For  soft-decison  decoding,  equations  (A-29)  and  (A-30)  and  inequality 
(A-22)  with  b  =  1  give 


^b  < 


2v 

a2  Z 


[l  -  vZ 


,v-1 


(2*^  -  1  -  v)z"]^ 


(A-31) 


A-3.  SOFT-DECISION  DECODING 

Hie  function  Q(6)  can  be  defined  in  general  as  the  probability 
that  the  cumulative  metric  for  an  incorrect  sequence  at  distance  5  from 
the  correct  sequence  exceeds  the  cumulative  metric  for  the  correct 
sequence.  Bbr  block  codes,  the  sequence  is  a  codeword;  for  convolu¬ 
tional  codes,  the  sequence  is  a  path  segment.  In  soft-decision  de¬ 
coding,  the  sequence  with  the  largest  associated  metric  is  converted 
into  the  decoded  output.  Let  mQ(k,L)  denote  the  value  of  the  cumulative 
metric  associated  with  sequence  k  of  length  L.  To  derive  inequality 
(A-  18),  we  consider  additive  metrics  of  the  form 

V.  Odensfalder,  Dual-k  Convolutional  Codes  for  Noncoherently 

Demodulated  Channels f  International  Telemetering  Conference  (1976),  165, 
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L 

m-(lc,L)  =  I  ,  (A-32) 

°  i=1  ’ 

where  m^(k,i)  is  the  symbol  metric  determined  from  code  symbol  i.  Let  k 
»  1  label  the  correct  sequence  and  k  =  2  label  an  incorrect  one  at 
distance  6.  By  suitably  relabeling  the  6  symbol  metrics  that  may  differ 
for  the  two  sequences,  we  obtain 


Q(6)  =  p[mQ(2,L)  >  rn^CnD] 

r  ^ 

=  P  J  [m^(2,i)  -  m^(1,i)]  >  0 

|j  =  1 


{A-33) 


where  P[A]  denotes  the  probability  of  event  A,  The  right-hand  side  of 
this  equation  can  be  bounded  by  the  inequalities  of  appendix  C,  We 
obtain 


f  «  ,1 

Q(6)  <  a  min  E 

exp 

s  1  [m  (2,i)  -  m,(1,i)] 

1  i=1  ’  1 

0<s<s^ 

(A-34) 


If  inequalities  (C-8)  and  (C-9)  are  satisfied,  which  is  the  usual  case 
in  practice,  then  inequality  (A-34)  represents  the  Che rnoff- Jacobs  bound 
and  a  *  1/2;  otherwise,  inequality  (A-34)  represents  the  Chernoff  bound 
and  a»  1.  Ihe  assumption  that  the  m,(2,i)  -  m^(1,i),  i  =  1, 
2,  .  .  5,  are  Independent,  identically  distributed  random  variables 

and  the  definition 

Z=  min  E  exp{a[m  (2,i)  -m  (1,i)]}  {A-35) 

0<s<s^  L  J 

yield 


Q(«)  <  oZ^  . 


(A-36) 


ttxe  assumptions  required  to  establish  this  inequality  are  reasonable  in 
moat  practical  cases,  especially  when  symbol  interleaving  is  used. 

Calculations  for  specific  communication  systems  operating  in  white 
Gaussian  noise  have  shown  that  soft-decision  decoding  gives  a  superior 
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performance  relative  to  hard-decision  decoding.  Approximately  2  dB  of 
additional  signal  power  is  required  for  a  hard-decision  receiver  to 
produce  the  same  error  rates  as  the  corresponding  soft-decision  re¬ 
ceiver.  However,  soft-decision  systems  are  much  more  complex  to  im¬ 
plement  and  may  be  too  slow  for  the  processing  of  high  information 
rates.  Quantization  is  necessary  in  soft-decision  receivers  because 
digital  computations  are  performed  in  the  decoders.  Since  the  appro¬ 
priate  quantization  levels  depend  on  the  signal,  thermal  noise,  and 
interference  levels,  automatic  gain  control  is  required.  Finally,  when 
the  interference  is  not  similar  to  white  Gaussian  noise  and  has  unknown 
parameters,  the  appropriate  soft-decision  metric  is  often  difficult  to 
determine,  may  be  a  function  of  the  signal  level,  and  may  not  yield  a 
significant  performance  advantage  relative  to  hard-decision  systems. 
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APPENDIX  B. — SOFT-DECISION  DECODING  FOR  FREQUENCY-HOPPING  SYSTEMS 


Figure  B-1  depicts  a  noncoherent  frequency-hopping  multiple 
frequency-shift  keying  (FH/MFSK)  receiver  that  implements  soft 
decisions.  After  the  dehopping,  the  received  signal  passes  through  an 
MFSK  demodulator.  The  detector  outputs  are  sampled  once  every  code 
symbol.  After  each  sampling  time,  the  appropriate  quantized  sample 
value  is  added  to  the  stored  values  in  one  or  more  accumulators  in  the 
decoder.  When  block  codes  are  used,  each  accumulator  is  associated  with 
a  possible  codeword.  All  the  code  symbols  in  a  received  sequence  are 
sampled,  and  then  the  final  accumulator  outputs,  which  are  called  the 
cumulative  metrics,  are  compared.  The  codeword  associated  with  the 
largest  metric  value  is  then  converted  into  the  decoded  output.  When 
convolutional  code?  are  used,  each  cumulative  metric  is  associated  with 
a  particular  code  path.  The  decoded  output  is  the  sequence  corre¬ 
sponding  to  the  path  having  the  largest  cumulative  metric. 


Figure  B-1.  FH/MFSK  receiver  with  soft-decision  decoding. 


Let  represent  the  ith  quantized  sample  value  that  enters  accumu¬ 
lator  k.  We  consider  the  cumulative  metric  defined  by 

r  2 

mg(k,L)  =  I  '  (B-1) 

i  =  1 

where  L  is  the  number  of  samples  used.  This  metric  is  chosen  because  it 
is  mathematically  tractable  and  it  is  known  to  be  optimal  for  Rayleigh 
fading. 

To  apply  the  general  coding  results  of  appendix  A,  we  must  evaluate 
Z,  %»hich  is  defined  in  equation  (A-35).  In  the  subsequent  analysis,  the 
degradation  due  to  imperfect  quantization  is  neglected.  Let  R^^  denote 
a  sample  value  from  the  detector  that  receives  the  Intended  signal  plus 
noise  and  Interference.  Let  R2^  denote  a  sample  value  from  a  detector 
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that  receives  only  noise  and  interference,  which  are  approximated  by 
band-limited  white  Gaussian  processes.  Suppose  that  an  intended  signal 
with  power  Rg  and  form 


s,  (t)  =  cos  Olt 

1  s 


(B-2) 


is  received  during  each  hop.  It  is  shown  elsewhere^  that 


r2  =  z2  +  z2 
21  3i  4i 


{B-3) 


where  the  n  =  1,  2,  3,  4,  are  independent  Gaussian  random  varia¬ 

bles.  The  expected  values  are 


s(2u!  • 

E[22il  =  EfZjJ  .  .  0  . 

Ttie  variances  are 


(B-4) 


VAR(Z,J  =  VARtz^J  =  N,  , 
var(z3J  =  var(z^J  -  , 


(B-5) 


Where  is  the  total  noise  power  (thermal  noise  plus  interference) 
accompanying  the  signal  and  Nj  is  the  total  noise  power  in  the  other 
detector  output.  The  conditions  for  the  Chernoff-Jacobs  bound  with  Sq  > 
0  (see  app  C)  are  satisfied  by  J  r|.  -  r2  , 

i  I  ^ 


We  assume  that  R^,  and  are  statistically  independent  of  each 
other  and  from  hop  to  nop,  that  is,  for  all  values  of  i.  Then  equation 
(A-35)  becomes 


^D,  J.  Torrieri,  Principles  of  Military  Coimunication  Systems,  Artech 
House,  Dedham,  MA  (1981)t 
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Z=  rain  E[exp(sR|^)]E[exp(-8R2^)] 
0<s<s^ 


(B-6) 


where  is  the  largest  value  of  s  for  which  the  expected  values  reraain 
finite.  Por  a  Gaussian  random  variable  X  with  mean  m  and  variance  a 


direct  calculation  yields 


EfexpfsX^]]  - - - - exp/ - ,  s  <  — ^ 

yrrr;:^2  li-2saV 


(B-7) 


Using  equations  (B-3)  to  (B-5)  and  (B-7)  in  equation  (B-6),  we  can 
evaluate  the  conditional  expectations  given  the  values  of  N^  and  N2. 
Substituting  X  =  2sN^,  we  obtain 


min  C(X)  , 
0<X<N^/N2 


(B-8) 


where 


C(X)  =  E 


R  ' 

[ — L-)  _£ 

M  +  x-*  N^ 


,  0  <  X  < 


(B-9) 


and  the  expected  value  is  with  respect  to  N^  and  N2. 

There  are  four  possible  values  of  the  pair  (N^,N2),  depending  upon 
which  of  the  two  detectors  are  jammed.  For  J  jammed  channels  out  of  M 
total  channels,  the  associated  probabilities,  P[  ],  are  derived  from 
elementary  combinatorial  analysis.  The  results  are 


(M- 

p[N,  =  N,  =  N.  ]  =  - ^ -  F(0,M  -  2)  , 

Li  2  ti 


(B-10) 


P[N^  >  =  Nj 


,M  -  2^ 
Lj  - 


F(1 ,M  -  1 )  ,  (B-11) 


fM.  2. 

Lj  -  V 


•[N,  -  N^,N2  -  +  N.]  ^  F(1,M  -  1)  , 


(B-12) 
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p[n^ 


(.1 :  ?) 


(.t) 


P(2,M) 


(B-13) 


where  N^  Is  the  thermal  and  background  noise  power  In  a  channel,  N.  is 
the  jamming  power  in  a  jammed  channel,  and 

{1  ,  a  <  J  <  b  , 

(B-14) 

0  ,  otherwise  . 

Combining  equations  (B-9)  to  (B-14)  gives 


C{X) 


(“  ~  ^]f(0,M  -  2)exp| 


(t 


+  X 


0  (1  -  x2) 


(J :  -  „..p  (^) 


(jl 

-  1)exp 

.  R 

r  X  >>  s 

M  N 

m. _ _ _ _ _  V- 

(j)(1  + 

+ 

1 

L 

"t  J 

(B-15) 


— 

C  -  2^P<2,M)exp 


r) 


jj 


0(1  -  a2) 


0  <  X  < 


Nt  +  Hj 
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This  equation  can  be  expressed  in  terms  of  p,  ^tu'  ^it  using 
equations  (8)  to  (11)  in  the  main  body  of  the  text.  'Rie  upper  bound 
on  A  is  the  smallest  value  of  N^/N2  out  of  the  three  possibilities.  By 
using  numerical  analysis,  X  can  be  chosen  to  minimize  C(X),  thus  provid¬ 
ing  Z. 

Soft-decision  decoding  with  the  metric  of  equation  (B-1)  provides  a 
poor  performance  relative  to  hard-decision  decoding  against  optimal 
partial-band  jamming.  As  an  example,  figure  B-2  shows  the  upper  bound 
of  Pj^^  for  a  dual-k  convolutional  code  and  0  <  p  <  0.1.  Equations 
(B-15),  (B-8),  (8)  to  (11),  and  inequality  (A-31)  are  applied  with 

a  -  1/2,  )c  =  3,  V  =  4,  rg  =  3/4,  =  1000,  and  Rg/Nj_y  =  20  dB.  The 

graph  illustrates  the  vulnerability  of  the  soft-decision  decoding  to 
jamming  concentrated  over  a  small  portion  of  the  total  hopping  band. 


Figure  B-2.  Information  bit  error  probability  for  dual-3  convolutional 
code  (v  >■  4),  soft-decision  decoding,  and  partial-band  jamming. 

Decoding  errors  are  primarily  due  to  interference  that  causes  a 
single  term  in  the  summation  to  dominate  the  cumulative  metric  of  equa¬ 
tion  (B-1).  Clipping  the  would  Improve  performance,  but  an  effec¬ 
tive  implementation  requires  an  accurate  measurement  of  the  signal 
power,  which  is  often  Impractical. 
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Ifie  moment  generating  function  of  the  random  variable  X  Is  defined 

as  ^ 


M(s)  =  E[e®*]  = 


exp(sx)  dP(x) 


(C-1) 


for  all  s  for  which  the  Integral  la  finite,  where  e[  ]  denotes  the 
expected  value,  s  Is  a  constant,  and  F(x)  Is  the  distribution  function 
of  X.  In  general,  M(s)  Is  defined  for  some  Interval  Including  the 
origin.  Let  p[  ]  denote  the  probability  of  the  event  In  the  brackets. 
For  all  nonnegative  s. 


p[x  > 


dP{x)  <  I  exp(sx)  dF(x) 

'  Jo 


Comparing  equations  (C-1)  and  (C-2),  we  conclude  that 


(C-2) 


P[x  >  O]  <  M(s)  ,  0  <  s  <  s^  ,  (C-3) 

where  s^  Is  the  upper  limit  of  the  Interval  In  which  M(s)  Is  defined. 

To  make  this  bound  as  tight  as  possible,  we  choose  the  value  of  s  that 
minimizes  N(s),  which  we  denote  by  Sq.  Thus, 

P[X  >  O]  <  M(Sq)  ,  (C-4) 

where  s^  >  0  and 

M(Sq)  =  min  M(s)  .  (C-5) 

0<3<S^ 

Ihe  right-hand  side  of  Inequality  (C-4)  is  called  the  Chernoff  bound. 
Since  M(0)  «  1,  the  Chernoff  bound  Is  not  useful  unless  M(Sq)  <  M(0). 

If  the  moment  generating  function  Is  finite  In  some  neighborhood  of 

s  >  0,  we  may  differentiate  under  the  integral  In  equation  (C-1 )  to 
obtain  the  derivative  of  M(s),  which  Is 


^P.  Billingaley,  Probability  and  Measure,  John  Wiley  s  Sons,  Inc., 
Mew  York  (1979). 
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M'(s)  = 


X  exp(sx)  dF(x) 


(C-6) 


It  follows  that  M'(0)  =  E[x].  Differentiating  equation  (C-6)  gives  the 
second  derivative. 


M"(a)  = 


x2  exp(sx)  dF(x) 


{C-7) 


This  equation  shows  that  M"(a)  >0,  which  implies  that  M(s)  is  convex  in 
its  interval  of  definition.  Suppose  that 


E(X)  <  0  ,  P(X  >  0)  >  0 


(C-8) 


Then  M'(0)  <  0  by  the  first  assumption,  and  N(s)  oa  as  s  -»■  <»  by  the 
second.  Since  M(8)  is  convex,  it  has  its  minimum  value  at  some  positive 
s  *  Sq.  We  conclude  that  if  s.|  >  0,  inequalities  (C-8)  are  sufficient 
to  ensure  that  the  Chernoff  bound  is  less  than  unity  and  Sq  >  0. 

The  Chernoff  bound  can  be  tightened  if  we  assume  that  X  has  a  den¬ 
sity  function,  f(x),  that  satisfies 


f(-x)  >  f(x) 


(C-9) 


for  all  X.  Suppose  that  M(s)  is  defined  in  the  interval  s  <  s  <  s  , 
where  s^  <  0  and  s^  >0.  Then^ 


■L 

■r 


exp(sx)f(x)  dx 
exp(sx)f(x)  dx  -I- 


£ 


exp(sx)f(x)  dx 


[exp(8x)  exp(-sx)  ]f  (x)  dx 


^i.  M,  Jacobs,  Probability-of -Error  Bounds  for  Binary  Transmission  on 
Slatfly  Fading  Rician  Channel,  IEEE  Trans,  Inform,  Theory,  1^  (October 
1966),  431, 
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f 

£ 


2  cosh  (sx)  f(x)  dx 

» 

>2  I  f(x)  dx 

Jo 

=  2P[X  >  O]  . 


'Thus,  we  obtain  the  Chernoff-Jacobs  bound: 

P[X  >  O]  <  I  m(sq)  , 


where 


m(sq]  =  min  M(s)  . 

S2<s<Si 

The  parameter  Sq  is  not  required  to  exceed  zero  in  this  case, 
if  >0  and  inequalities  (C-8)  hold,  then  the  Chernoff-Jacobs 
less  than  1/2  and  Sq  >  0. 


(C-10) 


(C-11 ) 


However, 
bound  is 
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